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Abstract 



We present an interleaving scheme that yields quasi-cyclic turbo codes. We prove that 
randomly chosen members of this family yield with probability almost 1 turbo codes with 
asymptotically optimum minimum distance, i.e. growing as a logarithm of the interleaver 
size. These interleavers are also very practical in terms of memory requirements and 
their decoding error probabilities for small block lengths compare favorably with previous 
, interleaving schemes. 

Q, 

Index Terms: quasi-cyclic codes, convolutional codes, turbo codes, minimum distance, 
iterative decoding. 

> 

in 

^ ■ 1 Introduction 

It is now well known that the behaviour of turbo codes, although very powerful under high 
noise, exhibits an error floor phenomenon that can be explained by poor minimum distance 
properties. More specifically, it can be shown that for randomly chosen interleavers, the 
expected minimum distance of a classical two-level turbo code remains constant [201 CHI) i- e - 
does not grow with block length. Can the error floor behaviour of turbo codes be improved 
by designing the interleaver in a way that differs from pure random choice ? 

This question has been addressed by many authors and the answer has been shown to be 
affirmative. Two types of approaches have been used in trying to find improved interleavers: 
the first tries to modify as little as possible a randomly chosen interleaver by combinatorially 
avoiding configurations that yield small-weight codewords. This is in principle manageable 
since the expected number of codewords of constant weight in a turbo code remains constant 
(does not grow with block length). Indeed, this approach has met with significant success: 
perhaps the most widely known design of this type is the S -random interleaver that 
focuses on eliminating codewords of low weight corresponding to information sequences of 
weight 2. A more recent scheme of Truhachev et al. |27j weeds out all small-weight turbo- 
codewords in a way that is reminiscent of Gallager's method of excluding small cycles when 
constructing the parity-check matrix of an LDPC code, see also j2j for a similar result. They 
obtain turbo codes whose minimum distance grows proportionally to log N where ./V denotes 
the interleaver size. This asymptotic result is essentially the best possible since it was shown 
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by Breiling |S| that D/\ogN must be upper bounded by a constant, where D and iV denote 
respectively the minimum distance and interleaver size of the turbo code. 

The second approach tries to find interleavers with structure, in particular algebraic struc- 
ture, rather than mimic random choice. Besides enhanced performance, an additional motiva- 
tion is to have a permutation with a short description that will save on the memory required 
to store the interleaver connections. With this last feature in mind, a particularly promising 
family of interleavers was proposed by Tanner in |26j and consists of quasi- cyclic permutations 
that yield quasi-cyclic turbo codes. Encouraging simulation results for the simpler RA codes 
were obtained in [25], hinting at good minimum distance properties of quasi-cyclic turbo-like 
codes. To quote from the conclusion of 

"We conjecture that the class of quasi-cyclic permutations that will create quasi-cyclic 
turbo codes is rich, rich enough to contain codes that will perform as well or better than 
random interleavers. " 

In the present work we take up this challenge and study random quasi-cyclic permuta- 
tions. Our approach borrows from both the unstructured, almost random, and the algebraic, 
structured, design strategies: our interleavers have structure, and the inherent advantageous 
storage properties, and yet involve a certain amount of random choice. Our main result is 
to show that the typical minimum distance of the associated turbo code grows linearly with 
log N, i.e. has optimal growth, thus justifying Tanner's conjecture. Furthermore, for moder- 
ate lengths these interleavers turn out to be not only practical, but very efficient, comparing 
favorably with random, 5-random, and all known interleavers in a number of instances. 

The paper is organized as follows. In section 2 we give a short summary of previous 
work on interleaver design. In section 3 we describe our family of quasi-cyclic interleavers. 
Section 4 is devoted to proving that a randomly chosen interleaver from this family will have 
asymptotically optimal minimum distance with high probability (Theorem|HJ). Section 5 gives 
experimental results for short lengths (N = 400 and N = 1600). 

2 Previous work on interleaver design 

Classical channel coding systems using a serial concatenation of Reed-Solomon codes and 
binary convolutional codes include a matrix interleaver (also called block interleaver) which 
enables one to split the error bursts generated by the Viterbi decoder before applying an 
algebraic Berlekamp-Massey decoding (7]E3- The early research on interleavers for digital 
communications has been preceded by the invention of burst-error-correcting cyclic and burst- 
error-correcting convolutional codes |21j . Although the low density parity check codes devel- 
oped by R. Gallager ^1 integrated random interleaving of the parity-check matrix columns, 
no serious study on interleavers was known until the work by Ramsey on optimum interleavers 
for infinite length sequences |23j . For example, a type I Ramsey interleaver guarantees an 
input separation n\ and an output separation n-i with a minimum delay equal to n<i{n\ — 1), 
where n\ and ri2 are two positive integers satisfying ni < n± < 2ri2, n± and 7i2 + l are relatively 
prime. 

The separation guaranteed by Ramsey interleavers has been named spreading after the 
invention of parallel turbo codes based on binary systematic recursive convolutional con- 
stituents [HllIIl- Finite length interleavers or permutations designed for parallel turbo codes 
have been extensively studied during the last decade. The amount of publications on the 
subject ranges in the hundreds and cannot be listed here in full. The following selection of 
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interleaver families is an attempt to give a meaningful picture of the state of research and to 
summarize the main techniques. As mentioned earlier they can be crudely partitioned into 
two categories: mostly random interleavers with a weak structure, requiring an exhaustive 
description of the permutation, or strongly structured with short representations. 

• Purely random interleavers. 

These interleavers are built from permutations on N integers selected at random. Here, 
N denotes the interleaver size. The original turbo codes (N = 65536 bits) were designed 
with purely random interleavers. Without any interleaver optimization, the error rate 
performance of parallel turbo codes can be enhanced via primitive feedback polynomials 
in the turbo code convolutional constituents jlj. 

• Random interleavers with a weak deterministic structure. 

This family includes the S-random or spread interleaver proposed by Divsalar and Pol- 
lara 13 j. The S-random interleaver ir is constructed at random, it must satisfy the 
constraint \ir(i)—Tr(J)\ > S for all < S, where the maximal theoretical value of the 

spread S is y/~N. High spread random (HSR) interleavers proposed by Crozier belong 
to this family. They rely on the maximization of the spread S = min{|i— j| + |-7r(z)— 7r(j)|} 
(also defined in [2] for arithmetic and random interleavers). The spread of HSR inter- 
leavers is upper bounded by y/2N. The permutation described by Truhachev et.al. j^Tj 
that guarantees an asymptotically optimal minimum distance is mostly random with a 
weak deterministic structure. 

• Deterministic algebraic/arithmetic interleavers. 

Many algebraic permutations have been suggested or specifically developed for parallel 
turbo codes. In spite of (or perhaps because of) their very low memory, they tend to 
exhibit intermediate or poor error rate performance. A short selection consists of the 
interleavers described by Berrou and Glavieux [5], by Andrews et.al. 0, Sadjadpour 
et.al. [21], Bravo and Kumar j^]. The Relative Prime and the Golden interleavers 
described by Crozier et.al. ^Uj belong to this family of deterministic interleavers. 

• Deterministic interleavers with a weak random structure. 

We mention two types of deterministic interleavers where randomness has been added in 
order to unbalance somewhat the algebraic structure. Dithered golden interleavers [TU] 
and dithered relative prime (DRP) interleavers |12j . DRP interleavers exhibit excellent 
error rate performance. They are obtained in 3 steps: 1- application of a small permu- 
tation (input dithering) to the interleaver input, e.g., a size 8 permutation applied iV/8 
times, 2- a relative prime permutation j = s + ip, where j is the read position, i is the 
write position, s is a shift and p is prime relative to N, 3- an output dithering similar 
to the input one. 

• Interleavers from the graphical structure of codes. 

Cayley-Katz graphs with large girth have been used to design Generalized Low Density 
(GLD) codes with binary BCH constituents [221 • Similar application was made by Von- 
tobel [2H| to design turbo code interleavers from large girth graphs. Interleavers based 
on large girth graphs are all deterministic. Yu et.al. |29| also designed good interleavers 
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by looking at the loop distribution in the turbo code structure. Such interleavers are 
random with a weak deterministic structure. 

• Interleavers by other criteria. 

Abbasfar and Yao recently proposed good interleavers that eliminate codewords with 
Hamming weight less than a certain distance. The construction algorithm is based on 
a two dimensional representation of the permutation. This representation previously 
inspired Crozier ^"Q in his design of dithered-diagonal interleavers. The interleaver 
design by distance spectrum shaping can be classified in the class of random interleavers 
with a weak deterministic structure. Finally, we mention the interleavers designed by 
Hokfelt et.al. |17j via the minimization of the correlation between extrinsic informations 
under iterative decoding. 

The bi-dimensional quasi-cyclic interleaver described in the next section combines ran- 
domness and determinism in an almost equal manner. When designed from a square matrix, 
its quasi-cyclicity period is y/N, meaning that a set of 2y/~N integers is needed to save the bi- 
dimensional interleaver into memory, rather than the N integers needed for a purely random 
permutation. 

3 Bi-dimensional, or quasi-cyclic interleavers 

For simplicity, we restrict ourselves to the classical turbo code construction with a fixed con- 
stituent convolutional code Co of rate Rq = 1/2. The turbo encoder takes an information se- 
quence s of N bits, produces a first sequence of N check bits by submitting s = so, si, . . . sjv-l 
to an encoder for Co, and a second sequence of a further N check bits by submitting a per- 
muted version s % rQ\, s % m, . . . , s^ny-i), °f s to the encoder for Co- The overall turbo code 
rate is R = 1/3 and the interleaver is the permutation ir on the ordered set of information 
coordinates IN* = {0, 1, . . . , N — 1}. 

There will be a 2-dimensional structure inherent to our choice of permutation tt, therefore 
we shall restrict ourselves to the case when N = n\ x n<i is a composite integer. 

Let 7r be a permutation on N = {0, 1, . . . , N — 1} defined as follows. For any G 
{0, 1, . . . , m — 1} x {0, 1, . . . , ri2 — 1} define the function 

<f>: {0,l,...,ni-l} X {0,l,...,n 2 -l} -► X 

i-> ixn 2 +j 

Let a be a permutation of {0, 1, . . . , ni — 1} and let (Xj)j = o... n2 -i be a family of integers mod 
n\. Define the permutation II on {0, 1, . . . , n\ — 1} X {0, 1, . . . , ri2 — 1} by 

n(i, j) = (i + Xj mod rn,a(j)). 

Finally define the permutation 7r = i^n^ -1 on the set N. A small example is given in Figure ^ 
The quasi-cyclic nature of the permutation tt just defined is stressed in the following 
Lemma, a direct consequence of the definition. 

Lemma 1 A permutation tt belonging to the class defined above satisfies, for any x,x' € N 
such that x' = x + n2 mod N , 

7r(x ) = 7r(x) + 77,2 mod N. 
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(vr(0),7r(l),vr(2),...,7r(24)) = 
(3, 12, 5, 19, 21, 8, 17, 10, 24, 1, 13, 22, 15, 4, 6, 18, 2, 20, 9, 11, 23, 7, 0, 14, 16). 

Figure 1: Example: construction of ir, N = 25, n\ = n 2 = 5. Write 0,1,..., N — 1 in a 
square array A, apply a to permute columns, giving B, and rotate column j cyclically, by Xj 
mod 5, giving array C. Read off the rows to get 7r(0), 7r(l), 7r(2), .... 

If we make the trellis of the constituent convolutional code tail-biting, and if we write the 
check bits of the turbo code in the proper order, we obtain a quasi-cyclic turbo code |2*H] . 
For this reason, permutations of the above type will be called {ri\,n<i)- quasi- cyclic (or simply 
quasi-cyclic) . 

We shall take instances of (ni, n2)-quasi-cyclic permutations ir by choosing the permuta- 
tion a randomly, with uniform distribution, among permutations of {0, 1, . . . , n 2 — 1}, and 
by choosing the Xi,i = . . . ni — 1 randomly, with uniform distribution, among the set of 
integers mod m. We choose the Xj to be independent of each other and of a. This is a way 
of choosing tt uniformly in the class of (m, n2)-quasi-cyclic permutations. 

As a first comment, we may note that n has quite a lot more structure than a totally 
random permutation. A certain amount of randomness remains however; to quantify it some- 
what, suppose for example that n\ = n 2 = n = y/~N (we shall see experimentally in section [3 
that m = n 2 is a good choice) , we see that tt is defined by log n\ + n log n ~ ^/N log N random 
bits as opposed to the N log N bits that define an otherwise unstructured permutation. 

Our strategy will be probabilistic, i.e. we will estimate the probability that the permuta- 
tion 7r produces turbo code words of small weight w « log N and show that this probability 
must be vanishingly small. Interestingly, over all permutations tt, the expected number of 
turbo codewords of small weight w does not vanish with N. This is because of an all-or- 
nothing phenomenon. Permutations of the above type produce either no turbo codewords of 
small weight, or relatively many (at least n = v~N). 

4 Minimum distance analysis 

For any two integers x and y of K let us denote by d{x, y) the circular distance between x and 
y, i.e. the smallest non-negative integer d such that x + d = y mod iV or x — d = y mod N. 
Let us draw an edge between x and y whenever d(x, y) = 1, giving 3sf a circular structure: by 
an interval of N we shall mean a sub-path of 3ST. 

Let s = so, • • • ,sn-i be an information sequence, and let v C IN" be the support of s. 
The information sequence s generates a path in the (tail-biting) trellis of the convolutional 
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Table 1: Rate 1/2 recursive systematic convolutional codes. The parameter A is the minimal 
ratio of Hamming weight to trellis length among all codewords. 

code Co . Consider the partition 3sf = Z U 7 where Z is defined as the set of coordinates i for 
which the path associated to s goes from the zero state to the zero state. For every i € Z we 
have Si = and the corresponding check bit is also 0. The complement 7 of Z is a union of 
intervals 7 = [a±, b\] U [02, 62] U . . . U [a m , b m ]. The intervals [oj, bj] are sometimes called simple 
trellis paths, or simple error events in the convolutional coding terminology. The trellis of a 
recursive convolutional code has the property that the zero state can only be left at time t if 
St = 1 and it can only be reached from a nonzero state at time t if St = 1. This means that 
v C 7 and every interval [dj, bj],j = 1 . . . m starts and ends with an element of the support 
v of s. A recursive convolutional code also has the property of outputting a steady stream of 
non-zero symbols during the time it goes through a simple trellis path, i.e. during the time 
it is fed the information bits St for t £ [a>j,bj]. In other words, there exists a constant A, 
depending only on Co , such that the total weight of the convolutional codeword associated to 
the information sequence s is at least \ s ^Jj=i d(aj,bj). Some numerical values of A are given 
in Tabled by way of illustration. Summarizing: 

Facts: Associated to any information sequence s of support v there is a subset 7(s) C 3sf 
such that 

1. T(s) = [a±, bi] U [02, 62] U . . . U [a m , b m ] is a union of intervals of N 

2. v c 7(b) 

3. for any j = 1 . . . m, |v n [aj, bj]\ > 2 

4. on input s the convolutional encoder outputs at least A Y1T=1 d(dj, bj) nonzero symbols, 
for some positive constant A 

Let us call the trellis weight of s the quantity X]j=i d( a j, bj) defined above, denote it 
by Wt(s)- Now the turbo code word associated to s has its weight lower-bounded by both 
convolutional codewords corresponding to the input s and to the permuted input s n . Since 
the maximum is lower-bounded by half the sum, Fact 4 above implies: 

Lemma 2 // the information sequence s produces a turbo codeword of Hamming weight w, 
then W T {s) + W T {s n ) <2w/\. 

This last lemma says that low-weight turbo codewords can only exist if there is an infor- 
mation sequence s such that both s and s 71 " have small trellis weight. Now the decomposition 
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of the supports of s and s n into simple trellis paths is rather awkward to handle probabilis- 
tically, so we shall introduce a related concept that will be easier to deal with. The following 
definition is purely combinatorial. 

Definition 3 Let x = xq, x%, . . . xg, £ odd, be an even-numbered sequence of elements ofN. 
Let yi = ir(xi),i = 0...£ for some permutation it ofN. Let us call the %- weight of x the 
quantity: 

«v(x) = ^ d(x 2 i-i,x 2 i) + d(x ,xg) + ^ d(y 2 i,y2i+i)- 

l<i,2i<l 0<i,2i+l<£ 

The reason for introducing the above definition lies in the following lemma. 

Lemma 4 If there exists a codeword of weight w in the turbo code with interleaver ir, then 
there exists an even-numbered sequence x of distinct elements ofN of ir-weight w 7T (x) < 2w/X. 

Proof : Let s be the information sequence corresponding to the turbo codeword of weight w 
and let v be its support. Note that the support of s 1 is u = 7r _1 (v). Let T(s) = [ai,&i] U 
[a2, 62] U . . . U [a m , b m ] be the decomposition of T(s) into m intervals given by Fact 1 and let 
T(s 7r ) = [a'i, b^] U [a 2 , b 2 ] U . . . U [a' k , b' k ] be the corresponding decomposition for the permuted 
version s n of the information sequence. Now consider the bipartite graph whose vertex set is 
made up of the two sets A and B where A is the set of the k intervals [a-, &•], j = 1 . . . k, and 
B is the set of the m intervals [aj, bj],j = 1 . . . m. Put an edge between interval [a^, b'j] and 
[aj, bj] for every x G 7r _1 (v)n [a[, such that ir(x) 6 [aj, bj] (multiple edges may occur). Fact 
2 implies that the minimum degree of the bipartite graph is at least 2. Therefore there exists 
an (even-length) elementary cycle in the graph, i.e. a string of distinct vertices Vo, V\, ■ ■ ■ Ve, 
I odd, where the interval Vi belongs to A (respectively B) for i even (respectively odd) and 
where there is an edge between Vi and Vj whenever % — j = ±1 mod I + 1. For < i, 2i < £ 
the edge between V 2 % and V 2 i + \ is defined by an element of V 2 i n u that we denote x 2 i, 
and an element of V 2 i + i Pi v that we denote yn and that equals y 2 i = ir(x 2 i). Similarly, 
for 1 < i = 1, 2i < £, every edge between V 2 i and V 2 i-\ is associated to x 2 i-\ £ V 2 % and 
Vn-\ € V21-1 with y 2 i-i = n(x 2 i-i). Finally let xg e Vo and yi = ^(xg) £ Vg correspond to 
the edge between Vo and Vg. 

We have constructed a sequence x = xq, x\,...,X£ of elements of the support u = 7r _1 (v) 
of s w such that {x 2i -i,x 2 i} C V 2 i, 1 < i, 2i < £, {xg,xo} C Vo, and {y 2 i,y 2 i+i} C V 2 i+i, 
< i, 2i + 1 < I: see Figure |5| Therefore, denoting by £(V) the length of an interval V, we 
have 

i 

u; w (x) < ^LOQ < W T (s) + Wt(s^) 

which proves the result by Lemma [21 I 

We shall now study the probability that a sequence of small 7r-weight exists. We need 
some more notation. 

Let r = ri, r 2 , . . . , rg, £ odd, be a sequence of integers modulo N. Let |rj| denote the 
smallest absolute value of a (possibly negative) integer equal to ri modulo N, and let ||r|| = 

I + I f*2 1 + • • • + \ft\- Let xq G N. Together xo and r uniquely define the (£ + resequence 
x = x(r,x ) = x ,xt, . .. ,xg and y = y(r,x ) =y ,-.-,ye such that 

1. yi = Tr(xi),i = Q...£, 

2. for alH > such that 2% + 1 < £, y2i+i = V2i + ^2i+i mod A^" 

3. for alH > 1 such that 2i < £, x 2 i = x 2 i-\ + r2i mod N 
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Figure 2: t = 3. The cycle Vo, Vi, V 2 , V3 denned in the proof of Lemma El the associated 
sequences x = x , xi, x 2 , x 3 , y = 2/0, 2/1,2/2, 2/3, r = n,r 2 ,r 3 . 
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Figure 3: Let tt be the same as in Figure ^ The sequence r = 1, 1, 1 together with xq = 
define x = x(r, x ) = 0, 13, 14, 21. We have u%(x) = 1 + 1 + 1 + ei(0, 21) = 7. 



The definitions are illustrated in Figure 

Lemma |I] translates directly into the following, given that the x% are distinct only if all 
the Ti are non-zero. 

Lemma 5 If there exists a turbo codeword of weight w then there exists xq 6 "N and a non- 
zero sequence r = ri, . . . , rt, fj 7^ 0, i = 1 . . .£, £ is odd, that 2w / 'X-cycles at xq. 

We now have everything in place for doing the probabilistic analysis. Let Z TyX0 be the 
Bernoulli random variable equal to 1 if the sequence r M-cycles at xq and equal to otherwise. 
The set of all permutations tt of the set N is endowed with two probability measures, namely: 

• the uniform probability measure P r , in other words P T {^) = 1/N\ for all tt. 

• the quasi-cyclic probability measure P q defined by P q (ir) = l/(n" 2 n2!) if vr is {ni,n%)- 
quasi-cyclic and Pq(jr) = otherwise. Note that, as mentioned in section El this is 
equivalent to choosing the permutation a randomly, with uniform distribution, among 
permutations of {0, 1, . . . , n 2 — 1}, and by choosing the Xj, i = . . . n\ — 1 randomly, 
independently of each other and of a, and with uniform distribution, among the set of 
integers mod ri\. 

Lemma 6 Let M < N, x$ and r = r%, . . . , ri be given, r^ 7^ 0, i = 1 . . . I, t is odd. We have: 




(1) 



u> w (x(r,x )) < M. 



0. 



£, then P q [Z riXQ = 1] = 1. 

Proof : Point 1 is a direct consequence of (^Q). 

To see Point 2, consider x\,...,X£ as random variables. Conditional on the position of 
xg—i, i.e. on the event = k, the distribution of xg is, since ^ 0, uniform on the set 
Therefore 

Pr(Z T ,x = 1) = 
< 
< 

To see Point 3 argue as follows: write d(xo,X£) = qn 2 + p, < p < Since M < n 2 we 
have 2 ri0 = 1 if and only if 

(a) q = 

(6) p<M- ||r||. 

Since r£ ^ and M < n 2 imply that 7^ mod n 2 , we can argue as in point 3, replacing the 
random permutation ir of {0, 1, . . . , N— 1} by the random permutation a of {0, 1, . . . , n 2 — 1}, to 
obtain that the event (6) occurs with probability not more than 2M/(n 2 — 1). By construction 
of the quasi-cyclic permutation the event (a) is independent of (b) and occurs with probability 

l/m. 

Point 4 is simply due to the fact that for quasi-cyclic it we have tt(xo + 722) = vr(xo) + 
rc-2 mod iV for any xo G DNT, therefore d(xo, £f) = Si<j<£^j < M. I 

Next, we shall study the expected number of couples (r, xq) for which r M-cycles at xq, 
i.e. the expectation of the random variable 

Z = ^r,a;o- (2) 

x 6K,ri^0,||r||<M 

Since r must have only non-zero terms, its length £ cannot exceed its norm ||r||. The number 
of sequences of given norm m, length £ and non- negative terms is exactly (™), so that the 
number of terms in the sum © is not more than 

N E E 2e (™) =N E 3 m <iV3 M /2. 

l<m<RI0<e<m ^ ' l<m<M 

From this and Point 3 of Lemma El we obtain therefore: 



1. If ||r|| > M then P r [Z F;X0 = 1] = P q [Z r>Xo = 1] = 

2. If ||r|| < M then P r [Z r)Xo = 1] < 2M/(iV - 1). 
5. // ||r|| < M < n 2 , then P q [Z r>X0 = 1] < ^^ry. 
^. // ||r|| < M and r j = mod ri2 /or every i = 1 . . . 



2jP r [d(xi,a;o) < M- ||r|| | a^_i = /c]P r [a^_i = k] 



1 + 2(M- ||r|| 



k 

2M 
N - 1' 



iV- 1 



-P r [xz-i = k] 



1 + 2(M- ||r|| 
iV- 1 
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Lemma 7 Let M < n 2 . The expected number E q [Z] of couples (r, a?o) such that r M -cycles 
at xq satisfies, for the probability measure P q , 

E q [Z] <M3 M (l-l/n 2 )- 1 . 

Notice that Point 2 of Lemma El would give essentially the same estimate of the expected 
value of Z for uniformly random tt. However, the crucial property of the class of quasi- 
cyclic permutations that will make a big difference between choosing tt uniformly random 
and quasi-cyclic-random is the following direct consequence of Lemma ^ 

Lemma 8 // the sequence r M-cycles at xq for a quasi-cyclic tt, then r M-cycles at xq + 
n 2 mod N for tt. In particular, Z is a multiple of n\ for every quasi-cyclic permutation tt. 

This means that E q [Z] = Yl z >m z Pq[Z = z] > n\P q \Z > 0]. We have therefore that 
whenever the quantity E q [Z]/m is made to be vanishing with N, the probability that there 
exists a sequence x of tt- weight not more than M tends to zero. Putting together Lemma Q 
and Lemma 0] we obtain this section's main result : 

Theorem 9 For any constant C < A/2 and block length N = nxn 2 chosen to satisfy n 2 > 
^log 3 ni, the minimum distance of the random quasi-cyclic turbo code satisfies 

D > C log 3 ni 

with probability that tends to 1 as n\ tends to infinity. 

5 Experimental results for practical lengths 

In this section, we provide computer simulation results for the word error rate (WER) of 
parallel turbo codes using our new family of interleavers and comparing it with 5-random 
and random interleavers. The output of the turbo encoder is modulated via a binary phase 
shift keying (BPSK) modulation and transmitted over an ideal additive white gaussian noise 
(AWGN) channel. The turbo decoder performs iterative a posteriori probability estimation 
by applying the forward-backward algorithm to each convolutional constituent. 

Word error rate versus signal-to-noise ratio results are depicted in Figures El an d El In 
the first example, Fig. 21 illustrates the performance of a rate 1/2 turbo code with an 8-state 
recursive systematic convolutional constituent (13, 15)g. These octal generators have been 
adopted in the European third generation mobile radio standard UMTS |14| . The interleaver 
size is N = 400, n% = n 2 = 20, and the exact permutation is given in Table El As shown 
in Fig. 01 the bi-dimensional interleaver clearly outperforms the spread interleaver. The 
increase in minimum distance can also be validated numerically by measuring the turbo code 
minimum distance using the algorithm proposed by Garello et.al. jlHj . 

In the second example, the rate 1/2 turbo code has a recursive systematic convolutional 
constituent (37, 21)s, the octal generators proposed in the original turbo code by Berrou et.al. 
5 . The interleaver size is iV = 1600, n\ = n 2 = 40, and the exact permutation is given in 
TableEl As shown in Fig. El we get a significant improvement over the S-random interleaver. 
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Square Bi-dimensional Q 


uasi-cyclic Interleaver of Size 400 




(T 


2 10 9 1 8 4 13 


7 14 3 11 6 12 17 5 15 16 18 


19 


X 


6 2 12 5 19 3 1 


4 17 10 18 9 8 7 11 15 14 13 


16 



Table 2: Bi-dimensional interleaver of size 400 = 20 x 20. The first row defines the column 
permutation a and the second row defines the column cyclic shift X. This square interleaver 
is used in conjunction with RSC(13,15) in Fig. 0J 



Square Bi-dimensional Quasi-cyclic Interleaver of Size 1600 


(T 


1 15 17 18 25 39 33 29 19 4 37 14 20 27 9 22 31 10 28 




30 36 23 35 7 16 6 2 13 26 3 34 32 21 11 8 5 38 12 24 


X 


29 30 21 10 39 11 26 4 28 15 22 25 31 3 34 23 18 17 32 27 




9 1 19 24 36 2 37 6 35 14 33 20 13 8 12 5 16 38 7 



Table 3: Bi-dimensional interleaver of size 1600 = 40x40. The first two rows define the column 
permutation a and the last two rows define the column cyclic shift X. This interleaver is 
used in conjunction with RSC(37,21) in Fig. \5\ 
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Figure 4: Performance of rate 1/2 turbo code for different interleavers of size 400 bits. Octal 
generators (13,15), coding rate is raised from 1/3 to 1/2 by puncturing parity bits, 32 decoding 
iterations, additive white gaussian noise channel, binary phase shift keying modulation. For 
all points drawn above, at least 100 block errors and 500 bit errors have been measured during 
Monte Carlo simulation to estimate the word error probability. 
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Figure 5: Performance of rate 1/2 turbo code for different interleavers of size 1600 bits. Octal 
generators (37,21), coding rate is raised from 1/3 to 1/2 by puncturing parity bits, 40 decoding 
iterations, additive white gaussian noise channel, binary phase shift keying modulation. For 
all points drawn above, at least 100 block errors and 500 bit errors have been measured during 
Monte Carlo simulation to estimate the word error probability. 
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